I should take care of this one #8375 here too. Not sure what's the best way. Maybe pinning dask?

edit: maybe add to ibis/pyproject.toml: added this. ✅

With this environment, I tried

• just flink up
• pytest ibis/backends/flink/tests

and pretty much everything fails with

E               RuntimeError: Java gateway process exited before sending its port number.
E               Stderr:
E               The operation couldn’t be completed. Unable to locate a Java Runtime.
E               Please visit http://www.java.com for information on installing Java.

for the record I do have installed apache-flink

cc: @chloeh13q @deepyaman any idea what's happening here?

EDIT: turns out I don't have java install (why would I 😛) . I'm trying to brew install and it goes through but it's asking me to do some things, but I don't know what's the prefer/recommended option here.
If anyone that runs flink stuffs can provide some insights it would be great : ) .

I did brew install java11

For the system Java wrappers to find this JDK, symlink it with
  sudo ln -sfn /opt/homebrew/opt/openjdk@11/libexec/openjdk.jdk /Library/Java/JavaVirtualMachines/openjdk-11.jdk

openjdk@11 is keg-only, which means it was not symlinked into /opt/homebrew,
because this is an alternate version of another formula.

If you need to have openjdk@11 first in your PATH, run:
  echo 'export PATH="/opt/homebrew/opt/openjdk@11/bin:$PATH"' >> ~/.zshrc

For compilers to find openjdk@11 you may need to set:
  export CPPFLAGS="-I/opt/homebrew/opt/openjdk@11/include"
==> Summary

@ncclementi I use sdkman to manage java because I have multiple versions of java running on my computer. Installing java 11 using sdkman is pretty straightforward, you just need to run

sdk install java 11.0.19-tem

and there is no extra step involved.

I don't remember having to symlink when I installed java11 via brew install; maybe try running the tests first to see whether it works?

FWIW go-shfmt isn't a Python package so it won't show up on PyPI or in requirements-dev.txt.